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'Pahu.dma? - Microsoft Internet Explorer 




Upload the images you want to use for your panorama p 
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After the images are uploaded, 
click here! 




panorama result - Microsoft Internet Explorer 




Here is your free panoramic image! 
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Click here to order a full resolution glossy print 



RECEIVE IMAGES OVER NETWORK 
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DETERMINE RELATIVE POSITIONS 










CORRECT PERSPECTIVE DISTORTION 


Toy 
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COMPUTE FOCAL LENGTH AND ANGLE FOR EACH IMAGE 


io(? 








MAP IMAGES TO CYLINDER 


log 








BLEND IMAGES 
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CREATE EMPTY "OVERLAP LIST" FOR STORING IMAGES 
IN POSITIONED LIST THAT OVERLAP THE UNPOSITIONED 
IMAGE 



i : 



in 



SET: 

BEST CONFIDENCE =0 
BEST CONFIDENCEJMAGE = NO.MATCH 
CURRENTJMAGE * FIRST IMAGE IN POSITIONED LIST 



7^ 



> DETERMINE OFFSET OF 
UNPOSITIONED IMAUti RELATIVE TO CURRENT IMAGE 
AND A CONFIDENCE VALUE FOR THE OFFSET 



ADD CURRENT IMAGE. THE OFFSET, AND THE 
CONFIDENCE VALUE TO THE OVERLAP LIST 



SET: 

BEST CONFIDENCE = CONFIDENCE VALUE 
BEST CONFIDENCE IMAGE=CURRENT IMAGE 



DHECK IF CURRENT IMAGE 
IS LAST IN POSITIONED LIST 
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SET CURRENT IMAGE TO NEXT IMAGE IN 
POSITIONED LIST 



YES 



SET REFERENCE IMAGE TO FIRST IMAGE IN OVERLAP 
71$ LIST 



GO TO ISO (FIG 7B) 



'Fig-7A 



FROM 72? (FIG 7 A) 



SET 

REFERENCE = NEXT 

IMAGE AFTER 
REFERENCE IMAGE IN 
OVERLAP LIST 



1S° 




CURRENT IMAGE 2 NEXT IMAGE AFTER REFERENCE IMAGE IN OVERLAP 

LIST 



YES 



CHECK IF 

ADJACENT LISTS INDICATE THAT CURRENT IMAGE IS_ 
vJECTED TO REFERENCED 



NO 



TRANSLATE CURRENT IMAGE AND ALL IMAGES CONNECTED TO IT 
RELATIVE TO THE REFERENCE IMAGE BASED ON THE OFFSETS OF 
THE REFERENCE AND CURRENT IMAGE TO THE UNPOSITIONED IMAGE 
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APPEND T HE: UNPOS ITI ONED I MAGE AND THE -VE OF I'HE OFFSET OW I ~ r fe 
THE CURRENT IMAGE RELATIVE TO THE UNPOSITIONED IMAGE TO THE 
ADJACENT LIST OF THE CURRENT IMAGE 




7^0 



SET 

CURRENT = NEXT IMAGE 
AFTER CURRENT IMAGE 
IN OVERLAP LIST 



APPEND THE UNPOSITIONED IMAGE AND THE -VE OF THE OFFSET OF 
THE REFERENCE IMAGE RELATIVE TO THE UNPOSITIONED IMAGE TO 
THE ADJACENT LIST OF THE REFERENCE IMAGE 




1 

TRANSLATE UNPOSITIC 
BEST CONFIDENCE IMAGE B> 
BEST CONFIC 


}NED IMAGE RELATIVE 

\SED ON THE OFFSET OF THE 

)ENCE IMAGE 


APPEND IMAGES IN OVERLAP Lt^T Mb THEIR OFFSfc TS TO THE 


ADJACENT LIST OF THE UNPOSITIONED IMAGE 
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ADD UNPOSITIONED IMAGE TO THE POSITIONED LIST 



7?0 
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GO TO 7ey (FIG 7A) 



Fig. 76 



DETERMINE CENTERMOST IMAGE BASED ON RELATIVE 
POSITIONS 


0/"0 
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CREATE LIST OF CORRECTED IMAGES THAT INCLUDES ONLY 
THE CENTERMOST IMAGE 






f 




CREATE UST OF UNCORRECTED IMAGES THAT INCLUDES 
EVERY IMAGE EXCEPT THE CENTERMOST IMAGE 





INITIALIZE BY SETTING: 
MAX OVERLAP _AREA=0 
SELECTED.WARPED IMAGE-UNDEFINED 
SELECTED UNWARPED IMAGE=UNDEF1NED 



$0$ 



SET: 

CURRENT WARPED-FIRST IN IMAGE IN CORRECTED LIST 
CURRENT UNWARPED«FIRST IMAGE IN UNCORRECTED LIST 
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COMPUTE OVERLAP AREA BETWEEN CURRENTWARPED AND 
CURRENT UNWARPED 




CHANGE SELECTED IMAGES BY SETTING: 
MAX OVERLAP AREA-OVERLAP AREA 
SELECTED WARPED IMAGE»CURRENT WARPED 
SELECTED UNWARPED JMAGE-CURRENTUNWARPED 




SET CURRENT WARPED = NEXT IMAGE IN UST OF 
CORRECTED IMAGES 



SET: 

CURRENT JJNWARPED = NEXT IMAGE IN UST OF 
UNCORRECTED IMAGES 
CURRENT WARPED = FIRST IMAGE IN UST OF 
CORRECTED IMAGES 
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YES 




CORRECT THE PERSEPECTIVE OFStUtre ^UNWARPED 
RELATIVE TO SttMCftb WARPED BASED ON THEIR RELATIVE 
' POSTIONS 
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MOVE CURRENT UNWARPED IMAGE FROM UST OF 
UNCORRECTED IMAGES TO LIST OF CORRECTED IMAGES 
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Fig. 8 





Original Image 








2-D coordinates 


4-D coordinates 


Vertex 0 
Vertex 1 
Vertex 2 
Vertex 3 
The i th vertex 


(xo, yo) 
(xi, yi) 
(X2, y 2 ) 
(x3,y3) 
(xi, yO 
/ 

' \ZO 


(x 0 ,y 0 , 0,1)' 
(xi.yi, 0,1)( 
(x 2 ,y 2 , 0, 1) 
(x 3 ,y 3 ,0, 1) 
(xi, yi, 0, 1)^ 
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Perspective Correction Transformations 
1 . Translate outwards : 



10 0 0 
0 10 0 
0 0 10 
0 0/1 



2. Three rotations: 



0. = 



1 0 
0 cos0 r 



0 

sin 9 



0 -sm9 x cos# 



0 
0 
0 

0 1 



©„ = 



cosO y 0 -sm9 y 



s\n9 y 0 cos^ 



0 0 



0 
0 
0 
1 



0. = 



"cos0, sin# z 0 0" 

-sin#. cos#. 0 0 

0 0 10 

0 0 0 1 



3. Translate inwards: 



T„ = 



1 
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4. Effect of focal length on Perspective: 



P = 



10 0 0 
0 10 0 
0 0 0 i 



0 0 0 1 
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Perspective Correction 
Perspective Corrected Image Vertices given by: 

Pi =p i T a Q : e y e x T b P = [x i ,y i ,z i ,w i ] ^ 



But: 



J 

1ST- 



x y 
w, = — '- (- sin 0, sin 0 X + cos 0, sin 0 V cos 0 V ) + — (cos 0. sin 0 r + sin 0, sin 0„ cos 0 r ) + cos 0„ cos 0 

and Xj' and y\ from the perspective corrected image are given by: 



and y ' = 



x' = x /l ana y\ 

/ w i / w i 



Therefore we can write: 

^(*,,*,.V)-*;=o 

Taking: 

We can write: 



i a 



bo 



-F(t) 



x o -F Xo (9 z ,0 y ,0 x ,f) 



x,-F Xi {9 z ,e y ,e x ,f) 
y t -F yi {9 z ,e y ,e x J) 



Newton's Method 

By Newton's method of numerical computation, t is an estimate of the values 

k 8y A 

then: 

t new =t-J' l F(t) 
is a better estimate of the values. 
Where 7"' is the matrix of partial derivatives: 
_ dF 
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ITIAL1ZE FOCAL LENGTH AND ROTATION ANGLI 
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COMPUTE COORDINATES OF VERTICES OF PERSPECTIVE DISTORTED 
IMAGE BASED ON FOCAL LENGHT AND ROTATION ANGLES 
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COMPUTE ERROR BETWEEN COMPUTE COORDINATES OF VERTICES 
AND ACTUAL COORDINATES OF VERTICES FROM MANN METHOD 
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DETERMINE JACOBIAN MATRIX 
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MULTIPLY ERRORS WITH INVERSE OF JACOBIAN MATRIX TO 
DETERMINE CORRECTION TO ROTATION ANGLES AND FOCAL LENGTH 
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UPDATE FOCAL LENGTH AND ROTATION ANGLES BASED ON 
CORRECTION 






[0\1^ — — — checkIf — — 

correction > threshold ' 



YES 



DONE 
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Fig. 11 
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SET PIXELS OF ALL IMAGES VISIBLE EVERYWHERE 



SET CURRENT IMAGE TO FIRST IMAGE 



I 



SET CURRENT IMAGE TO NEXT AFTER CURRENT IMAGE AND REFERENCE IMAGE TO FIRST 

IMAGE 



DETERMINE OUTLINE OF PANORAMIC IMAGE FORMED BY ALLIGNING THE CURRENT AND 
REFERENCE IMAGES BASED ON THE RELATIVE POSITION OF THE SEGMENT 
CORRESPONDING TO THE CURRENT IMAGE 
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DETERMINE LINE DIVIDING PANORAMIC OUTLINE (I.E., LONGEST LINE JOINING POINTS 

WWFRF RORHFRS OF PIIRRFNT IMA OF ANT) RFFFRFNPF TMAPtF TNTFRSFPTi 



DIVIDE PANORAMIC OUTLINE INTO TWO SECTIONS BASED ON LINE 



I 



DETERMINE WHICH OF THE TWO SECTIONS HAS LESS OF THE CURRENT IMAGE THAT IS NOT 
OVERLAPPED BY THE REFERENCE OUTLINE 



SET CURRENT IMAGE TO NOT BE INVISIBLE IN THE DETERMINED SECTION 
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DETERMINE MASKING VALUE FOR EACH PIXEL OF CURRENT IMAGE BASED ON VISIBLE 

ARFA OF IMATtF AND PRCVlMITYTn niVinrhJO ! TNJFS 
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1230 



ANY MORE IMAGES AFTER CURRENT 
JMAGE l_ 

NO 



YES 



OVERLAP IMAGES BASED ON MASKING VALUES TO CREATE A PANORAMIC IMAGE 
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Fig. 12 



( DONE ) 
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SET REFERENCE TO 
NEXT IMAGE AFTER 
REFERENCE IMAGE 




